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Oeneral  mathematical  problems  arising  in  the  scientific 
study  of  predation  have  been  studied  from  a  variety  of  view¬ 
points.  Primary  emphasis  has  been  given  to  the  descriptive 
aspects  of  the  prey  and  predator  populations  under  various 
assumptions  concerning  interactions  among  the  different 
members  of  the  populations  during  these  processes  and  to  birth 
and  death  processes.  In  particular,  we  wish  to  call  attention 
to  the  recent  paper  by  MacArthur,  as  well  as  to  the  classical 
works  of  Volterra,  Lotka,  and  Chiang. 

The  major  objective  of  this  note  is  to  show  how  the 
functional  equation  technique  of  a  new  mathematical  discipline, 
dynamic  programming,  can  be  used  in  formulating  and  solving — 
both  analytically  and  numerically — a  variety  of  problems  of 
optimal  predation.  We  wish  to  determine  optimal  predation 
policies  and  are  thus  interested  in  the  control,  as  opposed  to 


the  descriptive,  aspects  of  predation  processes. 
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SOME  MATHEMATICAL  ASPECTS  OP  OFTIMAL  PREDATION 
IN  ECOLOGY  AND  BO VI CULTURE 

Richard  Bellman  and  Robert  Kalaba 
The  RAND  Corporation 
Santa  Monica,  California 


1.  Introduction 

General  mathematical  problems  arising  in  the  scientific 
study  of  predation  have  been  studied  from  a  variety  of  view¬ 
points.  Primary  emphasis  has  been  given  to  the  descriptive 
aspects  of  the  prey  and  predator  populations  under  various 
assumptions  concerning  interactions  among  the  different  members 
of  the  populations  during  these  processes  and  to  birth  and  death 
processes.  In  particular,  we  wish  to  call  attention  to  the 
recent  paper  by  MacArthur  [lj,  where  additional  references  can 
be  found,  as  well  as  to  the  classical  works  of  Volterra  £2], 

Lotka  [3],  and  Chiang,  [6j. 

The  major  objective  of  this  note  Is  to  show  how  the 
functional  equation  technique  of  a  new  mathematical  discipline, 
dynamic  programming  [4]  can  be  used  in  formulating  and  solving-- 
both  analytically  and  numerically--a  variety  of  problems  of 
optimal  predation.  We  wish  to  determine  optimal  predation 
policies  and  are  thus  interested  in  the  control,  as  opposed  to 
the  descriptive,  aspects  of  predation  processes. 

2.  An  Ecological  Process 

Let  us  suppose  that  memoers  of  two  different  populations, 
called  type  I  and  type  II,  are  present,  and  that  memuers  of  type 
I  prey  on  members  of  type  II,  but  not  conversely.  L*t  us  further¬ 
more  suppose  that  the  presence  of  neither  type  is  desirable  (e.g. 
bacterial  populations),  and  that  we  possess  a  drug  (or  other 
technique  such  as  radiation)  which  is  effective  in  destroying 
members  of  population  type  I,  but  is  ineffective  against  those 
of  type  II.  Our  task  is  to  determine  the  most  efficacious  mode 
of  administration  of  the  drug  in  an  effort  to  control  the  two 
populations.  The  problem  is  not  trivial  since  the  administration 
of  maximal  dosages  of  the  "drug"  may  deplete  the  type  I  population 
to  such  an  extent  that  type  II  population  may  become  dangerously 
large. 
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To  east  such  a  problem  in  more  mathematical  form  let  us 
Introduce  a  bit  of  nomenclature: 

(1)  u(t)  *  size  of  population  I  at  time  t, 

(2)  v(t)  «  size  of  population  II  at  time  t, 

(3)  w(t)  *  rate  of  administration  of  the  drug  at  time  t. 

We  then  consider  the  populations  to  be  described  by  the 
differential  equations  and  initial  conditions 

(4)  u  =  kx(w(t))u,  u(0)  =  c1# 

v  =  k2(w(t))v  ~  k^(w(t))u,  v(0 )  =  c2, 

which  hold  for  u,  v  £  0  and  for  0  t  <;  T,  where  T  is  the 
duration  of  the  process.  We  measure  the  undesirability  of  the 
two  populations  at  any  time  t  by  the  expression  a1u(t)  + 
a2v(t).  Our  objective  is  to  determine  w  *  w(t),  0  £  t  £  T, 

in  such  a  manner  that  we  make  the  functional 

(5)  max  Uju(t)  +  apv(t)l 

0£t£Tl  1  *  i 

be  as  small  as  possible.  In  place  of  the  usual  forcing  term 
effect  of  control,  we  assume  in  writing  (*0,  that  the  Influence 
of  the  drug  is  to  affect  the  growth  and  interactions  of  the  two 
populations. 

We  introduce  the  function  f(ci,c2#T),  defined  oy  the 
relationship 

(6)  f(c,,cp,T)  =  min  max  ♦  a  v(t}), 

1  w  0£t£T‘  *  * 

and  use  the  principle  of  optimality  [^]  to  derive  the  ‘unc clonal 
equation 

* 

(T)  f(c1#c2,T)  -  max  ax<  L  +  a2c2,  rain  f(cx  +  k^Wjc^, 

l  w 

* 

c2  -  k2(W)c2h  -  k^SOCjh.T  -  h)  .  o(h) . 

This  can  be  used  for  computational  purposes,  in  conjunction  with 
the  terminal  condition 


(S) 
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*  alCl  +  a2c2 * 

or  can  be  used  as  the  oasis  for  further  analytical  studies. 
Lastly,  we  remark  that  the  function  f(ci>c2'T)  Is  homogeneous 
of  degree  one  In  c^  and  e^,  a  fact  which  can  be  used  to 
advantage  computationally  to  reduce  the  dimension  of  f  from 
two  to  one. 


3.  Bovlculture 

Suppose  we  have  a  herd  of  cattle  with  x^  head  of  age  1, 
1  =  0,1,2,  ...,K-  1,  and  xK  head  of  age  K  or  older.  Each 
year  we  can  either  send  some  of  the  cattle  to  market,  each 
individual  of  age  1  being  of  worth  w^,  or  we  can  keep  them 
to  build  up  the  herd.  We  suppose  that  memoers  of  age  1 

give  rise  to  b^x^  calves  in  a  year  and  that  Is  the 

fraction  of  individuals  of  age  i  surviving  to  age  1  +  . 

For  an  N-stage  process,  N  *  1,2,...,  we  wish  to  H.nd  the 
optimal  breeding  policy,  that  is,  the  policy  that  results  In 
maximal  overall  return.  We  shall  assume  that  the  last  decision 
must  oe  to  send  all  cattle  to  market. 

We  introduce  the  sequence  of  functions 


(l)  fN(xo#xl,x2* *  *  * ,Xk)  ~  return  from  an  N-stage  pro¬ 

cess  beginning  with  x^  cattle 
of  age  i  and  using  an  optimal 
predation  policy,  N  -  1,2,.... 


First  we  observe  that 

(8)  r^vw 


.*K) 


1  w^x^ , 


1.0 


and  then  we  use  the  principle  of  optimality 
functional  relationships 


fk4l^x0'xi,’**'xK) 


f  * 

1  wJyJ  * 


max 

J  *0 


to  derive  the 

. . .  #aN_2xN-2,aTf-lxN-l 
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valid  for  k  *  1,2, ... . 

The  sequence  of  functions  f^.fg....  is  determined  re¬ 
cursively,  beginning  with  f^.  Simultaneously,  we  determine  the 
optimal  values  of  y^,  which  tell  us  how  many  cows  In  each  age 
group  to  send  to  market  in  terms  of  the  current  composition  of 
the  herd  and  the  time  remaining  in  the  process. 

Problems  of  this  nature  can  be  solved  analytically  In  a 
number  of  cases;  cf.  Bellman,  Olicksberg,  Gross  ^7j. 

4.  Discussion 

The  two  simplified  models  which  have  been  sketched  here 
serve  but  to  suggest  what  can  be  done  with  regard  to  predation 
and  oreedlng  processes  using  modem  mathematical  techniques  and 
employing  high-speed  digital  computing  machines.  Additional 
papers,  in  which  a  variety  of  stochastic  and  adaptive  [5] 
features  are  Incorporated,  will  be  prepared. 

We  wish  to  acknowledge  the  fruitful  discussions  that  we 
have  had  with  I.  Cooper,  J.  Digoy,  J.  Jacquez,  and  J.  Lyman. 
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